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The sequence of a-trimmings of empirical probabilities is shown to converge, in the Painleve- 
Kuratowski sense, on the class of probability measures endowed with the weak topology, to the 
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1. Introduction 

Depth-trimmed regions arc sets of central points with respect to a multivariate proba- 
bility distribution or a data cloud. Given a mapping that associates each point with its 
degree of centrality, which is traditionally called depth, the set of all points whose depth is 
at least a given value constitutes a central or depth-trimmed region. Therefore, central re- 
gions are set-valued location estimates. Their applications range from simple descriptive 
statistics to multivariate generalizations of univariate quantile-based techniques. Numer- 
ous proposals of depth-trimmed regions have been considered in the statistical literature 
in recent years; see, for instance, Masse and Thcodorescu [8] for half-space trimmed re- 
gions, Koshevoy and Mosler [7] for zonoid trimmed regions, Cascos and Lopez-Diaz [3] 
for integral trimmed regions and Zuo and Serfling [12] for a unifying treatment of several 
notions of central regions. 

Cascos and Lopez-Diaz [3] introduce the integral trimmed regions as a family of depth- 
trimmed regions that is generated by a set (or family of sets) of functions. Several classical 
families of depth-trimmed regions like the zonoid or the halfspacc regions can be obtained 
in the framework of integral trimmed regions for suitable families of functions. Integral 
trimmed regions have been used, among other families of depth-trimmed regions, by 
Cascos and Molchanov [4] to assess the financial risk of a vector portfolio. The concept 
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of the a-trimming of a probability plays a crucial role in the construction of integral 
trimmed regions and thus a comprehensive study of its properties would constitute a 
significant advance in the theoretical study of depth-trimmed regions. In particular, the 
analysis of the behaviour of the a-trimming of empirical probabilities is necessary for the 
study of empirical integral trimmed regions. 

Motivated by this, the problem of the consistency of the a-trimming of a sequence 
of empirical probabilities is analyzed in this paper. On the basis of such a consistency, 
applications to integral trimmed regions and to other trimmed regions based on the 
trimming of a probability will be developed. 

Throughout the paper, the symbol V will stand for the class of probability measures 
on (R d ,Bd), where Bd denotes the Borel cr-algebra on R d . This class will be endowed 
with the weak topology. 

As has already been mentioned, the main results of the paper are focused on the 
concept of a-trimming of a probability of V, which can be defined as follows. 

Definition 1. Given PgP and a G (0, 1], the a-trimming of P, denoted by P a , is given 
by P a = {Q G V:Q < a~ 1 P}, that is, the set of all probability measures Q on (R d 1 Bd) 
such that Q(B) < a~ 1 P(B) for all B G B d . 

This set of probabilities was formally introduced by Cascos and Lopez-Diaz [3] an- 
alyzing several properties of such a set. Sets of probabilities that are bounded by a 
transformation of another probability have been studied by, among others, Huber and 
Strassen [6] in the field of robust statistics and Artzncr et al. [1] in the field of financial 
mathematics. 

From now on, given P G V, {Xi}i will be a sequence of independent and identically 
distributed random vectors, where X\ induces the probability P. Let {P n } n C V be the 
sequence of empirical probabilities generated by {Xi}i. 

Given P G V, {P n } n a sequence of empirical probabilities and a G (0,1], this paper 
analyzes the behaviour of the sequence of probability sets {-P"}n in relation to the set 
P a . Namely, it is proved that the sequence {-P"}n converges (almost surely) to P a . 

The usual concepts of lower limit and upper limit of sequences of subsets of a space 
with a convergence criterion will be considered. Limits of sequences of sets are understood 
in the Painleve-Kuratowski sense, that is, a sequence of sets converges if its lower and 
upper limit coincide, this being equal to the limit. 

Since V is endowed with the convergence of the weak topology, we have 



lim sup P' r 



n 




and 



lim inf PI 



n 



QeP: 3{Q„}n with Q n G P" Vn G N, and limQ„ = Q 



n 



where the limits inside the brackets are considered in the convergence of the weak topol- 
ogy- 
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The structure of the paper is as follows. Section 2 is devoted to study of the limit 
behaviour of the cc-trimming of an empirical probability and applications of this limit 
behaviour to depth-trimmed regions are derived in Section 3. 

2. Trimming of empirical probabilities 

The aim of this section is to show that given a probability P and a G (0, 1], the set 
of probabilities P a is the limit (almost surely) of the sequence of the sets of probabilities 
{P"} n - More specifically, the main result will conclude that 

lim inf P*=P a = Urn sup P% a.s. 

" n 

This section contains three parts. First, we analyze some supporting properties in 
relation to the topological structure of the trimming of a probability. The second part 
contains some key technical results for the main purpose of the section. Finally, the study 
of sequences of the trimming of empirical probabilities is developed. 

We will now state some results about topological properties of the trimming of a 
probability. 

A family of probabilities II C V is said to be tight if, for each e > 0, there exists a 
compact set K C R d such that P{K) > 1 - e for all P G U. It is well known that if P e V, 
then the family {P} is tight. 

Lemma 2. Let II C V be a tight family and a G (0, 1]. Then, {Q G H a : H G 11} is tight. 

Proof. Since II is tight, given e > 0, there exists a compact set K C R d such that H(R d \ 
K) < ea for all H 6 II. So, for any Q € H a , we have that Q(R d \ K) < a^ 1 H(R d \K) < e, 
which implies the result. □ 

Lemma 3. For all a G (0, 1] and P G "P, the family P a is compact for the weak topology. 

Proof. By Lemma 2, the family P a is tight, so its closure in the weak topology cLP" is 
compact (see, e.g., Billingsley [2]). Thus, it is sufficient to prove that clP" = P a . 

Let Q G clP Q . There then exists {Q n } n C P a with lim n Q n = Q in the convergence of 
the weak topology. 

Let G be an open set in R d , so Q(G) < liminf„ Q n (G) < a~ 1 P(G). If A G Bd, we can 
take a decreasing sequence {G„}„ of open sets in R d with AcG n and P(G n \A) < 1/n 
(observe that P is regular), so Q(A) < Q{G n ) < a- 1 P{G n ) for all n G N. Then, Q(A) < 
a^ 1 P(A), which implies that Q G P a , so P a is compact. □ 

Lemma 4. Let FgP and a G (0, 1] . There then exists a countable set T> C P a such that 
T> is dense in P a in the weak topology. 

Proof. Note that the weak topology is mctrizable, for instance, by means of the Prohorov 
metric and P a is compact in such a topology, which trivially implies the result. □ 
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In order to obtain the main result of this section, some essential technical results are 
stated below. 

The following proposition shows how to construct an element of the class P^+i by 
means of a probability of the class P". This result will play a crucial role in posterior 
constructions of sequences of probabilities. 



Proposition 5. Let FeP and a € (0, 1]. If Q n € P", then the probability Q n +i given 
by 

n 1 
Qn+i = —rQn + — -r((n + l)P„+i - nP n ) 
n+1 n+1 

belongs to the class P" +1 . 

Proof. It should be pointed out that the mapping (n + l)P n +i — nP n :Bd—*R satisfies 
((n + l)P n+ i — nP n )(B) = Ib(X u +i) for all B € Bd and is therefore a probability. As a 
consequence, Q n +\ belongs to V. 

Further, (n+ l)P n+ i — nP n is a discrete probability. Since Q n € P", it follows that Q n 
is absolutely continuous with respect to P„, which implies that Q n is also discrete and 
so the same holds for Q n +\. 

Thus, in order to check that Q n +i £ Pn+i, it is sufficient to prove that Q„+i({a;}) < 
a-iPn+^ix}) for all xeR d . 

Let x€R d . If x^Xn+i, then ((n+l)P n +i - nP n )({x}) = 0, so 

= -JtQt.(M) < a- 1 ^-P n ({a ; }) = a- 1 P n+1 ({a ; }). 
n+1 ?i+l 

If ar = then ((n + l)P n+ i — nP n )({x}) = 1, which implies that 

n n 

Qn+l({x}) = —— Qn({x}) + —— < a- 1 —-P n ({x}) 



n+1 n+1 n+1 n+1 

_ 1 nP n ({x}) + l 

<" r~i =a p n+i({x}) 

n + 1 

and this finishes the proof. □ 



Note that, given Q n G P", the reiteration of the construction of probabilities described 
in the statement of the above proposition leads to the probability 

n 

Qn+k(-) = —TQn(-) + -— r (/(.)(*„+!) +/(.)(X„ +2 ) + • • ■ + 7 ( .) (X n+k )) (1) 
11 ~r rC Tl ~r rC 

for all fee {1,2,...}. 

A technical lemma on stopping times that will be applied in posterior results is stated 
below. 
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Lemma 6. Let {Zi}i be a sequence of independent and identically distributed random 
variables with EZ\ = 0. For all n G N, let S n = ^™ Z{. We define Y\ = min{n G N : S n > 
0} and for k > 1, let Y k +i = min{n > Yk : S n > 0}. 
Then, 

lim = a.s. 

k Yfe 

Proof. Given Zi, . . . , Z n , the smallest er-field which makes these mappings measurable 
will be denoted by o~(Zx, . . . , Z n ). 

In the first place, we should point out that the probability that the event J^? %i ^ 
occurs infinitely often is equal to 1. 

We define W =0,W± = mm{n >0:J2i Z i> °l and ; for k > h lct w k+i = min{ri > 

Note that Wk is a stopping time since, for all k € N, it holds that Wk is o~(Zi, . . . , Zw k )- 
measurable. Also, Wk S N a.s. for all k £ N. 

Moreover, the random variables {Wfc+i — VFfcjfc are independent since Wk+i — Wk is 
a(Zw k +i, ■ ■ ■ , Zw k+1 )-mcasurable for all fc € JV and is obviously identically distributed. 

Well-known results on stopping times state that EW\ < oo since EZ\ £ R (see, e.g., 
Wijsman [11] or Durrctt [5]), so E(W k+1 - W k ) = E(Wi - W ) = EWi < oo. 

The strong law of large numbers applied to the sequence {W^+i — Wk}k leads to 

W n+ x W n+1 -W n 
hm = LW i a.s., hence lim =0 a.s. 

n n n n 

On the other hand, it can immediately be seen that for each I £ N, there exists ki G N 
such that Y l+1 -Yi<W kl +i- W kl . 

It is enough to consider ki with ki = sup{n : W n < Y{\. Observe that such a ki exists 
a.s. since Wi =Y\. In accordance with the definitions of {Wi}i, {Yi]i and ki, we obviously 
have W kl+ i > Y h 

Moreover, Yi + \ — Yi < W kl +i — W kl , otherwise Sw k +i > 0, which contradicts the defi- 
nition of Y;+i. In fact, W kl +i > ij+i- 

Trivially, {Y}i is a non-decreasing sequence, F n > n, lf n > n for all n G N and {/c/}; 
is nondecreasing, so lim; ki = oo a.s. Then, 

< hm sup < hm sup 5 L < lim sup ■ = a.s. , 

i Yi i W kl i h 

which proves the lemma. □ 

Cascos and Lopez-Diaz [3] prove the following result in relation to the trimming of a 
probability. 

Lemma 7. Let a G (0,1] and Q G P a . There then exists a.s. a sequence {Q nk }k C V 
such that Q nk G P^ k for all k G N and \iuik Q Uk =Q in the weak topology. 
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This result is proved by constructing a particular sequence {Qn k }k satisfying the above 
conditions. Since we will make use of such a sequence, it will be described below. 

If Q £ P a , then Q is absolutely continuous with respect to P. Therefore, there exists a 
mapping g : R d — ► [0, oo) of class L 1 (P) such that for all B £ Bd, it holds that Q(B>) = 
J B gdP, that is, g is a Radon-Nikodym derivative of Q with respect to P. 

If g is a Radon-Nikodym derivative of Q with respect to P, wc can explicitly give a 
sequence {Q nk }k satisfying the conditions of Lemma 7 as 

Qn k (B) = j-^ / g dP nk for all B £ B d , (2) 

\\g\\Li(p nk ) Jb 

where rik must satisfy ||<?||li(p„ ) > 1- 

That is, if we denote by Nq the set of indexes of the above subsequence, then 

1 " 

n £ Nq if and only if - - 1) > 0. (3) 

n t=i 

Note that the probability that the event n _1 ^™ (\d(^i)\ — 1) > occurs infinitely often 
is equal to 1. 

We should indicate that the a.s. existence of a converging subsequence with limit Q 
in Lemma 7 depends on g, a Radon-Nikodym derivative of Q with respect to P and it 
thus depends on probability Q. For a detailed explanation of this construction, we refer 
to Cascos and Lopez-Diaz [3]. 

Proposition 8. Let {Xi\i be a sequence of independent and identically distributed ran- 
dom vectors, where X\ induces the probability P. Let g be a Radon-Nikodym derivative of 
Q with respect to P. Let {rik}k be defined by n\ =min{n £ N : n" 1 (\g(Xi)\ — 1) > 0} 
and for k > 1, let nk+i = min{n > rifc : n~ l ^ 1 (|<?(Xi)| — 1) > 0}. Lt then holds that 

,. n k+ i-n k 

hm = a.s. 

k n k 

Proof. Note that the random variables {\g(Xi) \ — 1}; are independent and identically 
distributed. Since E\g{Xi) \ = J Rd gdP = Q(R) = 1, their expected values are equal to 0, 
thus the result is a direct consequence of Lemma 6. □ 

It is now proved that any probability of the class P a belongs almost surely to the 
inferior limit of the sequence {P"} n - 

Proposition 9. Let P£V, a £ (0, 1] and Q £ P a . Then. 

Q 6 liminf a.s. 

n 

Proof. Lemma 7 states that Q £ limsupP^ a.s. In fact, we have a specific sequence 
{Qn k }k with Q, lk £ P" k for all k £ N such that limfc Q nk = Q a.s. in the weak topology. 
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We recall that Nq is the set of indices of this sequence which was already characterized 
in (3). 

We will complete this subsequence in the following way. Given n\ G Nq, if ri\ + 1 ^ Nq, 
we define the probability Q ni +\ G -P^i+i by m eans of Proposition 5, that is, 

Tl\ 1 

Q ni +i = — r-rQm -I rr(( ni + ^^i+i _ mPnJ, 

n\ + 1 ni + 1 

continue until ri! + k G iVg and let ni + k = n 2 (note that Qn 2 nas already been defined). 
We then reiterate this process with n 2 and so forth with successive indexes. 

In this way, for all n > n 1; we have a probability Q n 6 P" such that if / € Aq, then Q; 
belongs to the subsequence described in (2). In order to finish the proof, we must show 
that lim„ Q n = Q a.s in the weak topology. 

Since lim„ P n = P a.s. in the weak topology, {Pi, P 2 , . . .} is tight a.s. (see, e.g., Billings- 
ley [2]) and so Lemma 2 implies that the family IJ^Li satisfies the same property. 
Hence {Q n } n > ni C U,T= ni P n is also tig* 1 * a - s - 

As a consequence, in order to prove that lim„Q n = Q a.s., it is enough to show that 
a.s., given any subsequence {Qi k }k C {Qri}n with linife Qi k = Q' for some Q' G V, we have 
Q' = Q. 

Let us consider a subsequence satisfying the above conditions and let Nq> be the set 
of indexes of such a subsequence. 

Clearly, if \Nq> n Nq\ = oo, the uniqueness of the limit implies that Q' = Q. 

Suppose now that \Nqi (~l Nq \ < oo. Then, given rife G Nq, we define (whenever it exists) 
l' k = inf{?fe G Nq> : rife < Zfc < rife+i} (note that there exist infinite values of li). Observe 
that {Qv k } k C {Qi k }k, and so lim fc =Q'. 

In accordance with (1), it is trivial that 

Qv k {-) = ^Q nk (-) + Uh.){x nk+l ) + I ( .)(X nk+2 ) + ■■■ + /(.)(X^)). 
L k l k 

Moreover, 

< Ul { . } (X nk+1 ) + 7 (0 (X nk+2 ) + ■■■ + J (0 (X lt )) < < "*+*-"* . 

J fc L k 1l k 

Proposition 8 then implies that 

lim - r (/ ( . ) (X nfc+1 ) + 7 (0 (X„ fc+2 ) + • • • + Z ( .) (X,, )) = a.s. 
On the other hand, 

hm — = lim — - — 11 + 1 = 1 a.s. 

k k 



and so 



]imQu =]imQ nk =Q a.s. 

k k k 
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in the weak topology. Then, Q = Q' a.s., which proves the theorem. □ 

The a-trimming of P is (almost surely) contained in the lower limit of the a-trimmings 
of the empirical probabilities, as shown below. 

Theorem 10. Let P EP and a E (0, 1]. Then, 

P a C liminf P£ a.s. 

n 

Proof. Lemma 4 proves that there exists a countable set T> C P a such that V is dense 
in P a in the weak topology. Given any Q ET>, Proposition 9 implies that Q £ liminf „ P" 
a.s. and since T> is countable, V C liminf„P" a.s. 

Finally, liminf„P" is closed in the weak topology, thus cYD C liminf„P" a.s., where 
cl stands for the closure in such a topology. 

Since P a C cYD, we have P Q C liminf „ P" a.s. and this trivially concludes the proof. □ 

The next result refers to the upper limit of the sequence {P"} n . 
Theorem 11. Let P EP and a £ (0, 1]. Then, 

limsupP^cP" a.s. 

n 

Proof. Let Q £ limsup ra P^. There then exists a sequence {Qn k }k C P with Q nk £ P" fc 
for all k £ N such that linifc Q nk = Q in the weak topology. 

Since lim„ P„ = P a.s. in the weak topology, for any open set G in R d , 

Q(G) < liminf Q„ k (G) < liminf oT x P nk (G) 

k k 

< hmsupa-^n^clG) < ^-^(clG) a.s., 

k 

where clG stands for the usual closure of the set G. 

If F is any closed set in R d , consider G m — {x £ R d : d(x, F) < 1/m}, where d(x, F) = 
inf{||x - y\\ :y £ F} and m £ N. 

For all m£N, it then holds that Q(F) < Q{G m ) < a _1 P(clG m ) a.s. and so Q(F) < 
a- 1 P(F) a.s. 

Since this inequality holds for all closed sets in R d , given A £ Bd we have only to 
consider an increasing sequence {F m } m of closed sets in R d with F m C A, P(A\F m ) < 
1/m and Q(A\F m ) < 1/m for all m £ N. Note that this is always possible since P and Q 
are regular probabilities. Therefore, Q(A) < a^ 1 P(A) for all Ae Bd a.s. and so Q £ P a 
a.s. □ 

Finally, the main result of this section is obtained as a consequence of Theorems 10 
and 11. 
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Theorem 12. Let PgP and {P n } n <ZV be a sequence of empirical probabilities of P. 
Then, for all a G (0, 1], it holds that the sequence {-P"}n converges a.s. in the Painleve- 
Kuratowski sense to the set P a , that is, 

limP™ = P a a.s. 



3. Applications to depth-trimmed regions 

Applications of the preceding results to depth-trimmed regions are developed in this 
section. In the first place, we introduce a new family of depth-trimmed regions based on 
the trimming of a probability and study its empirical counterpart by means of the results 
in Section 2. The analysis of empirical integral trimmed regions is then developed. 

For each centrality degree a, a depth-trimmed region of level a is a set-valued loca- 
tion estimate. Given any (point-valued) location estimate associated with a probability 
measure, we will build a-trimmed regions for each probability P G V as the set of all 
location estimates of the probabilities in the a-trimming of P. Formally, these regions, 
which we will call location trimmed regions, can be defined as follows. 

Definition 13. Let a G (0, 1], let L be a location estimate on the class V and let P G P. 
The location a-trimmed region of P induced by L, denoted by D1(P), is defined as 

D a L (P) = {L(Q):QeP a }. 

Note that some well-established trimmed regions can be obtained by means of location 
trimmed regions, taking appropriate location estimates. 

For instance, consider the zonoid trimmed regions defined by Koshevoy and Mosler [7] 

as 

ZD Q (P) = (Jxg(x)dP, g: R d ^> [0, a" 1 ] measurable with J g(x)dP = l 

for any a G (0, 1] and P G V . 

It is easy to see that if we consider the expected value as location estimate, that is, L 
stands for the expected value, then it holds that ZD Q (P) = D£(P). 

The following proposition concerns, under mild conditions, the consistency of empirical 
location trimmed regions. 

Theorem 14. Let L be a location estimate that is continuous with respect to the weak 
topology. Then, for any P G V and a G (0, 1], the empirical location trimmed regions tend, 
in the Painleve-Kuratowski sense, to the population trimmed region, that is, 



Dl(P)=]imD2(P n ) a.s. 



Consistency of the a-trimming of a probability 



589 



Proof. Let x e D£(P). There then exists Q 6 P a such that x = L(Q). Theorem 12 states 
that Q G lim ra P" a.s., so there exists a.s. a sequence {Q n } n C V with Q n G P£ for all 
nEN such that lim„ Q„ = Q in the convergence of the weak topology. 

Since L is continuous when such a topology is considered, then x = L(Q) = lim n L(Q n ) 
and thus D£(P) C Iiminf n D£(P n ) a.s. 

Conversely, let x G limsup n D2(P„). There then exists a sequence {cc ra( .}fc with x nk G 
D2(P Tlfc ) such that x = limj, a;„ fc . Therefore, there exists Q rik G P" fc with .T rlfc = L(Q nk ) 
for all fc G iV. 

Since {Qn k }k C U^Li^n an d this set is tight, there exists a subsequence {Q nfs }; C 
{Qn k }k converging in the weak topology to a certain QsP. Theorem 11 implies that 
Q G P a a.s., hence x = lim; x nk = lim; L(Q nk ) = £ D£(P) a.s., which proves that 
limsup„ Dg(P„) C Dg(P) a.s., so the result holds. □ 



The definition of the integral trimmed regions is based on the concept of a-trimming 
of a probability. Formally, they are defined as follows. 

Definition 15. Given a e (0, 1] and a set of measurable functions T from R d into R, 
the integral a-trimmed region of P with respect to the set T , denoted by D^-(P), is defined 
as 

D£(P) = i x e Rd : 3 Q* e pa mth f( x )< J f d Qx f° r al1 f e 

= u nHf-oojftQ]). 

Integral trimmed regions satisfy, under mild conditions in the generating families of 
functions, some convenient properties for general trimmed regions, such as being nested, 
affinc invariant, closed or bounded (see Cascos and Lopcz-Di'az [3]). 

We will obtain a result for the empirical version of integral trimmed regions. 

Some concepts which appear in this study are briefly described, in particular the 
concepts of a Glivenko-Cantelli class for a probability and the concept of an envelope of 
a family of functions. 

Given P e V, a family of measurable functions (from R d into R) T C i 1 (P) is said to 
be a Glivenko-Cantelli class for P if 



liml sup 



/dP„ 



fdP 



a.s. 



A measurable mapping fjr is said to be an envelope of the family of functions T if 
|/| < Jr for all / G T. 

For a more detailed explanation on these concepts and their applications see, for in- 
stance, Talagrand [9] and van der Vaart [10]. 
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Theorem 16. If J 7 is a Glivenko-Cantelli class for P of continuous and bounded func- 
tions with an envelope f? G L l {P), then for all a G (0, 1], it holds that 



H liminf D"' £ (P„) = D%(P) a.s., 

£>0 

where 

T> a /(P) = |. T e R d ; 3Q X G P a with f{x) - e < J fdQ x for all f e^"|. 

Proof. Theorem 27 in Cascos and Lopez-Diaz [3] states that under the conditions of the 
theorem it holds that 

P| limsupD^ e (P„) = D£(P) a.s. 

e>0 " 

Therefore, 

P| Iiminf D^ £ (P n ) C D£(P) a.s. 

£>0 

and only the other inclusion remains to be proven. 

Let D be a countable and dense subset of D^-(P) and x G D. There then exists Q G P a 
with f(x) < J fdQ for all / G T. 

Let us take the sequence {Q T i}n>rii constructed in Proposition 9. 

We split the set {n G N : n > rii} into two sets, namely Nq (see expression (3)) and 
{n€N:n>ni}\N Q . 

In Cascos and Lopez-Diaz [3], it is proved that for the subsequence determined by Nq, 
it holds that 



lim 



sup 



fdQ nk - / fdQ 



= a.s. 



Now, consider the subsequence determined by {n G N : n > ni} \ Nq . 
Given n in this set, then rik <n < nu+i for some k with nk, nk+i G Nq. From (1), we 
have 

Qn(0 = ^Qn k (-) + i(/(.)(X nfc + 1 ) + I { .)(X nk+2 ) + ■■■ + I ( .)(X n )), 

which implies that 



j=n k +l 

Since rifc G iVg, equation (2) implies that 

fdQ nk = I FT ^ dP„ fc . 

J \\9\W{p nk ) 
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Hence, we obtain that 

fdQ n - I fdQ 

fg 



sup 



sup 



< sup 



nk 
ii 



llfflU 1 ^*) 
fg 



\g\\Li(p nk ) 



n . 

dP ^ + - E f{X 3 )-JfgdP 

1 E w 

71 * 



■dP nk - ffgdP 



j=n k + l 



When n tends to oo, since rife < n < rik+i, rife also tends to oo and, in accordance with 
(4), we obtain that 



lim 

n V/e> 



sup 



"A- 



fg 



■dP n 



n J \\g\\Li(p„ k ) 



fgdP 



= lim ( 



sup 



rik 



— / /dQ„ fc ^ / fdQ 



= a.s. 



Note that rik/rik+i < rtfc/ra < 1 and from Proposition 8, it follows that limfc rik/nk+i = 1 
a.s., so limfc rifc/n= 1 a.s. 

Regarding the term n Y^j=n k +i ff(Xj)-, we trivially obtain that 

V, E Mx j ) = -Y,fAx j )--Y,fAx j ) 

= 1 E.w^)---E^)- 



n nfe 



On the other hand, fjr g L 1 (P) and since J frdP = E(fp(X\)), the strong law of 
large numbers implies that 

(-. n , "fc \ 

- MX,) - -r- E -fr(^) = ^(.fr(^O) - = a.s. 

3=1 J=l / 

As a consequence, we conclude that the sequence {Q n }n>n 1 satisfies 



lim sup 



fdQ n - / /dQ 



a.s. 



So, we have a.s. that for all e > 0, there exists no ^ N such that for all n > no, it holds 
that 



sup 



fdQ n - / fdQ 



e 

< -. 

~ 2 
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This implies that for all / £ we have f(x) — e < J f dQ n , so it holds a.s. that for all 
e > 0, the point x satisfies 

x G liminf D^-' £ (P, l ). 

n 

Since the lower limit is closed and D is countable, its topological closure satisfies 

cLD C Pi liminf D"' £ (P„) a.s. 

n 

£>0 

and, finally, 

D£(P) C Pi liminf D^ e (P„) a.s, 

1 1 n 

e>0 

which implies the desired result. □ 
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